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Abstract 

This paper proposes a decentralized recommender system by for¬ 
mulating the popular collaborative filleting (CF) model into a de¬ 
centralized matrix completion form over a set of users. In such 
a way, data storages and computations are fully distributed. Each 
user could exchange limited information with its local neighbor¬ 
hood, and thus it avoids the centralized fusion. Advantages of the 
proposed system include a protection on user privacy, as well as 
better scalability and robustness. We compare our proposed algo¬ 
rithm with several state-of-the-art algorithms on the FlickerUserFa- 
vor dataset, and demonstrate that the decentralized algorithm can 
gain a competitive performance to others. 

1 Introduction 

The paper discusses the decentralized recommender sys¬ 
tems, which is in contrast to the typical recommender sys¬ 
tems built on centralized infrastructures (the “cloud”, etc. ). 
The decentralized network ID had been thoroughly investi¬ 
gated in control and communication fields, defined as a set 
of distributed but connected agents, who are generally not 
strongly connected in a graph theoretic sense. Each agent 
collects data by itself, and executes computation via lim¬ 
ited communication within only local neighborhoods. Fig. 
1 shows a comparison of centralized versus decentralized 
network structures. Specifically, in a decentralized recom¬ 
mender system, individual users / user-groups can be viewed 
as network agents. Each user holds his or her own ratings 
as partially observed data. The data cannot be accessed by 
any intermediate point or centralized server in the network. 
Therefore, it has a potential effect on protecting user data 
privacy against both the cloud server and some malicious 
eavesdropping over uploading channels. For a large-scale 
network of mobile users, the decentralized models own a bet¬ 
ter scalability since users are only locally connected. Since 
data storages and computations are fully distributed, the de¬ 
centralized systems also become robust to center (cloud) or 
individual agent (user) failures. 

To our best knowledge, we are the first studying and 
designing a decentralized recommender system. There have 
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Figure 1: The comparison of a centralized network (left) and 
a decentralized network (right). 

been some recent interests in investigating algorithms in 
a decentralized fashion GM3, and moreover, preliminary 
literatures to reveal the convergence (4) and dynamics 0 
properties. All above make it solid and promising to build 
application scenes on a decentralized network structure. 

2 Model and Algorithm 

As a most popular tool in recommender system, Collabo¬ 
rative Filtering (CF) is usually formulated as matrix factor¬ 
izations problem 0 [HI- It predicts user rating R^ 7 (of 
i-th user on j-th item) as a dot product of the user profile 
of the i- th user, denoted as a row vector U\ and the item 
profile of the j-th item denoted as a column vector Vj, i.e., 
R ij = U 2 Vj. The recommendation problem can be formu¬ 
lated as solving the following matrix factorization problem: 

n n minu,v,z |||UV - Z||| 

( j s.t. Po(Z)=P^(R) 

Here Pq denotes the projection over the set of available 
ratings, and Z is an auxiliary matrix. 

It is assumed that CF is performed by L users jointly 
in a decentralized manner, and R is segmented into L non- 
overlapped parts, denoted as R*, i = 1, 2, ... 3 L. For example, 
the easiest case to segment R is to divide by columns. The 
i-th user (i = 1, 2,..., L) observes R^. Note some level of 
synchronization is still required to collaboratively utilize in¬ 
formation from all users. The trade-off strategy is to share 
partial data only among users in the local neighborhood. 
After observing the problem structure, authors in (2) sug¬ 
gested an variant of nonlinear Gauss-Seidel (GS) iterations, 
named decentralized matrix completion (DMC) algorithm. 
The i-th user will hold R^, as well as U^, V^, and based 
on its own computations. Note here is of the same size as 
U, and Zi of the same dimension as R^, so in other words, 




Algorithm 1 Decentralized matrix completion (DMC) algo¬ 
rithm for solving 

Require: Fh(Ri), (i = 1, 2,..., L); initializations of U^, V*, 
and Zi for each i-th user (i = 1,2step size /?; 

ITER 

1: FOR t=l to ITER DO 

2: Each i-th user updates Vi: V* = (Uj r Ui) _1 Uj r Zi 
3: Each i- th user updates Zp. Z i = UiVi + 

Po(R i -U i V i ) 

4: Each z-th user propagates to its one-hop neighbor¬ 
hood Ni. 

5: Each z-th user updates U^: 

TT _ 

— l+2p\Ni\ 

a.i=&i+ (3(\Ni\Ui - 

6: END 

Ensure: U$, V$, and Z i9 2 = 1,2, L 


Z i = UiVi. In each iteration, the 2 -th user first updates V* 
and Zi independently, then exchanging Ui with its one-hop 
connected neighborhood users, and finally update Ui via the 
average consensus algorithm0. The algorithm is summa¬ 
rized in Algorithm I. It obtains similar reconstruction errors, 
compared to centralized solutions 0. 

3 Experiments 

We compare our proposed algorithm with state-of-the-arts 
in this section, including Probabilistic Matrix Factorization 
(.PMF ) 0, and Collaborative Topic Modeling (CTR) (3, on 
a collected image recommendation dataset from Flickr. 

FlickrUserFavor dataset: The dataset contains 
350, 000 images collected from Flickr, from 140 user groups 
and uploaded by 20,298 users. We use the “like ” feedback 
provided by users as binary ratings. 75% of the rating matrix 
is used as training, and 25% as testing. 

Evaluation Measurement: We use the averaged ranked 
order of all the rated images in the testing dataset for a 
specific user to evaluate performances. Among these ranked 
images, we determine those for which a user has exhibited 
a “ like ” preference in the test data , and report the average 
percentile score (APS) of the ranked images which are 
indeed preferred by the user. The lower the APS, the better 
the algorithm is, which means the user preferred images are 
ranked in top positions. Finally, the mAPS is reported with 
the mean of the APS scores for all target users. 

Performance Comparision: PMF 0 is the most clas¬ 
sical collaborative filtering algorithm for recommender sys¬ 
tem. Wang et.al. also proposed the Collaborative Topic 
Model 0 which involves both content and user ratings, 
where we use the Hierarchical Gaussianization (HG) (H 
as the image features. For the proposed decentralized al¬ 
gorithm, we set the rank as 64, and using 8 agents. Detailed 


mAPS comparisons are shown in Table [T] It is shown that 
DMC is capable to achieve competitive performance as CTR , 
while is far better than PMF. Moreover, we do not use any 
content information in our algorithm, while CTR uses con¬ 
tent to indicates similarities between items. That suggests a 
further direction improve our algorithm too. 

Table 1: Performances of the proposed approaches compared 
with other baseline methods. The second column indicates 
whether or not the algorithm uses content information. With¬ 
out using content information and the fusion center, the pro¬ 
posed algorithm achieves a competitive performance. 


method 

Content 

mAPS 

PMF GO 

N 

61.99 

CTR 11 

Y 

52.76 

DMC 

N 

53.46 


4 Conclusion 

This paper discusses a decentralized recommender system. 
We formulate the popular collaborative filleting model into 
a decentralized matrix completion problem. Each user, 
with only partial rating data, can exchange user profile 
factors with its local neighborhood, while keep item profile 
factors private. We compare our proposed algorithm with 
several state-of-the-arts on the FlickerUserFavor dataset, and 
illustrate comparable results to the conventional ones. 
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